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1 Introduction 

The main purpose of this is to give an algorithm that quickly performs Stallings' 
Folding algorithm for finitely generated subgroups of a free group. First some 
definitions, motivations and then results. 

Let r be a directed labeled graph with the labels lying in some alphabet 
X = {ii, X2, ■ ■ ■ , Xn}. Such a graph is said to be folded if at each vertex v there 
is at most one edge with a given label and incidence starting (or terminating) 
at V. We now state the following topologically fiavoured definition. 

Definition 1.1. An elementary folding of a directed labeled graph F is a (con- 
tinuous) quotient map tt : F — > A, where A is another directed labeled graph, 
that is obtained by identifying two edges ei and 62, which at some vertex u, have 
the same incidence and label at v and if ei and 62 are edges between vertices 
V, w and v, w' respectively then the vertices w and w' are also identified. 

A folding process takes as input reduced words in Ji, . . . , Jm in X^^, makes 
a graph with m loops with labels Ji , . . . , Jm and attaches them all at some ver- 
tex vq to make a graph Fq which is a bouquet of m circles with labels Ji , . . . , Jm 
if read starting at vq and following the obvious convention with respect to in- 
cidence and inverses. The algorithm then consists of a sequence of elementary 
foldings until it is impossible to fold any further: 

Fo ^ Fi ^ . . . ^ Fm = F 

The process terminates because Fg has finitely many edges and each elementary 
folding decreases the number of edges by 1 . The output will be the folded graph 
F = F(Ji, . . . , Jm) which is independent of the sequence of foldings (see ^). 

Example 1.2. This is a folding for inputs: Ji = abba, J2 — a~^ba,J^ — aaa. 
The thickened edges represent the elementary foldings. The progression is to be 
read left to right, top to bottom. 
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When we get to a point where we can no longer fold and so we stop. From this, 
we can now infer that H = (Ji, J2, J3) = F{a, b) 

This folded graph gives us a picture of the subgroup H = (Ji, . . . Jm) < 
F{X). Topologically, if we view F{X) as the fundamental group tti{B^xq) of a 
bouquet of n circles S, then constructing T amounts to constructing the "core" 
of the covering space B of B corresponding to the subgroup iJ. [H [6] 

What is also of great interest are the "computational" properties of F. One 
can immediately verify that w ^ H by checking that w is the label of a loop 
based at vq. It follows that once F is constructed the membership problem 
for the word w and the subgroup H is solvable in linear time. If we take a 
spanning tree of F using the breadth first method, which takes time linear in 
the number of vertices of the graph, we can obtain a Nielsen Basis for H. We 
can also compute the index of H in F{X): if F is regular, i.e. at each vertex 
V for each x £ X there are edges with label x with both incidences, then the 
index is the number of vertices in F otherwise, [F{X) : H] ^ 00. There is also 
a bijective correspondence between spanning trees of F and Schreier systems 
of coset representatives (given a spanning tree T, take labels of subtrees of T 
rooted at vq that do not have any vertices of valency more than two). These 
systems of coset representatives are very important in the theory of rewriting 
systems. We now state the main result [3J[51[7]: 

Definition 1.3. The function log* : N — > N assigns to each natural number n 
the least natural number k such that: 

log o log o . . . o log(n) < 1 

^ v ' 

k times 

where we are using the base 2 logarithm. Equivalently log* {2") = log*{n) + 1. 
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Notice that: 

log*(22''') = log*(2. 1019^28) ^5 

It follows that for most practical purposes, log* grows so slowly that it can be 
considered a constant. 

Theorem 1.4. Let F{X) be the free group over the generators Xi, . . . , Xn, let 

Ji, . . . , Jm be words in X^'^ and let N = '^\Ji\. Then there is an algorithm 
for the folding process that given the input Ji, . . . , Jm will terminate in time at 
most 0{N ■log*{N)). 

Corollary 1.5. Given generators Ji,...,Jm as before and the subgroup H = 
(Ji, . . . , Jm) < F{X) we can: 

1. Compute the index of H. 

2. Obtain a Nielsen Basis for H. 

3. Get a Schreier Transversal 

In time 0{N ■log*{N)). And once T is constructed we can solve the membership 
problem for a word w in time 0(m) where m is the length of w. 

We can also slightly generalize the algorithm to obtain the following very 
useful fact: 

Theorem 1.6. Let A be any connected directed labeled graph. Suppose it has 
V vertices and E edges, then there is an algorithm that will fold A in time at 
most 0{E +{V + E)log*{V)). 

We first present the data structures that will be used in our algorithm and 
state results pertaining to running times of various operations. All this could 
then be coded using object oriented languages like Java or C++. 

2 Data Structures 

The terminology I will use is non-standard in computer science, but hopefully 
more comprehensible to mathematicians. The details in this section are only 
given for completeness, all that is really important here are the theorems on 
running times. 

For our purposes, a data type is a tuple {X, fi,. . ■ ,fm) where X is a set and 
/i , . . . , fm arc n-ary functions, i.e. functions with n arguments such that for 
each i and a fixed Fj: 

fi : X X . . . X X ^ Yi 

m times 

Moreover we allow the functions to be undefined and allow ourselves to change 
their values. These functions will be called operations. For example X = 7^(N) 
is the collection of sets of natural numbers, with binary operations, union, in- 
tersection and the unary operation least element (which a set to to a natural 
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number). We will also want to allow different instances of a data type, e.g. 
the data type is math students with the function grade: {students} — > R and 
we have two instances: calculus students and linear algebra students. Maybe 
some students will be taking both classes so they will have two grades, one for 
calculus and one for linear algebra it follows that there will be two instances 
of the grade function defined on different (though maybe not disjoint) sets of 
students. 

So far nothing can be said about running times. To this end we have to 
flesh out our construction, we give the actual algorithms that perform our op- 
erations. Primitive operations are unary operations (or simply functions) that 
either correspond to variable assignment or so-called pointers used in object 
oriented programming. We will directly invoke primitive operations in algo- 
rithms. We assume that the operating time cost of either evaluating a primitive 
operation or changing its value on one entry will be 1. 

Some operations will not be primitive, so to calculate them we will provide 
a method which is basically an algorithm which, using primitive operations, 
enables one to perform a more complicated operation. Once a method is given, 
it will be possible to calculate the running time of the associated operation. The 
reason the word method is used instead of simply algorithm is that we want to 
stress that it is at a lower level of abstraction, once it's given we want to forget 
everything about it other than its running time and the fact it works. As will 
be seen, there will also be a certain structure to the way the elements in our 
data type are interrelated which motivates the terminology data structure. 

The reason for this rather artificial formalism is mainly to ease analysis. 
The main algorithm that will be given in Section 13.31 will be given in terms 
of operations whose semantic meaning is clear and it will be obvious that the 
algorithm actually works. The explicit methods presented in this section will 
give us running times for our operations and we'll be able to compute the running 
time of the algorithm. 

As a remark to computer scientists, the definition of data type given here 
resembles an interface and combined with the methods, what we're actually 
describing is an abstract data structure. 

2.1 Ordered Sets 

This data structure actually is actually made of two interdependent components 
lists and list nodes. List nodes have two primitive operations: 

1. next : {list nodes} {list nodes} 

2. prev : {list nodes} {list nodes} 

And two operations that will require methods. 

1. list : {list nodes} {lists} 

2. remove : {list nodes} {lists} 
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For lists we have the two primitive operations: 

1. head : {Usts} — > {Ust nodes} 

2. tail : {lists} {list nodes} 
As well as the binary operation: 

1. concatenate:{lists} x {lists} {lists} 
Finally, wc need an operation to add a node to a list: 
1. addnodc : {list nodes} x {lists} {lists} 

So far we have two types of objects and some functions. An ordered set will 
be encoded as a doubly linked list. It can be thought of as a chain of list nodes. 

Example 2.1. Here we have a list L, and list nodes a,b and c. We have the 
following function tables. 



list node n 


next(n) 


prev(n) 


list(n) 


a 


b 


undefined 


L 


b 


c 


a 


undefined 


c 


undefined 


b 


L 



And 



ListX 


head(X) 


tail(X) 


L 


a 


c 



We represent this as as follows: 




A priori, there arc no restrictions on what values functions can take, but if 
we're not careful our list will not be well formed, for example: 



We can ensure that our structures will be well formed if we make sure that 
our methods keep structures well formed and only use these methods. We now 
give the methods associated to operations on ordered sets. When invoking a 
method we will use the typewriter font. The method associated to the function 
remove will be called remove and we will denote "performing the remove method 
on a list node n" by remove (n). This method does not return anything, it simply 
removes the list node n from a list while keeping it well formed 

remove (n): 

1. Get the variables /i=head(list(n)) and t=tail(list(n)). 

2. \{h = t = n then make head(list(n)) and tail(list(n)) undefined. 

3. lih = n then set head(hst(n))=next(n), set list (next (n))=hst(n), set 
prev(next(n))=undefined, and set next(n)=prev(n)=undefined. 

4. li h ^ n — t then do the same as the previous with prev and next inter- 
changed. 

5. If h ^ n ^ t then set next(prev(n))=next(n), set prev(next(n))= prev(n) 
and set next(n)=prev(n)=undefined. 

The next method is for the concatenate operation for two lists li,l2- We call the 
method concatenate, it appends the list nodes of h to those of h and leaves 

the list I2 empty. 

concatenate(/i, 

1. If head(l2) is undefined {I2 is empty) then do nothing. 

2. If head(Zi) is undefined, then set head(Zi)=head(Z2), set list(head(Z2))=^i, 
set tail(/i)=tail(l2), set list(tail(/2))=/i and set head(/2)=tail(l2)=undefined. 

3. Else set next(tail(/i))=head(l2), set prev(head(/2))=tail(li), set tail(li)=tail(/2) 
and set list(tail(Z2))=^i. 

The following illustrates the concatenate operation: 





The method addnode for the addnode operation will not be given, but it is 
quite obvious. The following theorem holds. 

Theorem 2.2. There exists methods of the operations remove, concatenate and 
addnode that take a constant amount of time. 

Proof. The associated methods remove, concatenate and addnode involve only 
a bounded number of primitive operations. □ 

We can also enumerate a list li, indeed take head(?i) then repeatedly perform 
"next" operations, once the value "undefined" is reached, the list is exhausted. 

2.2 Disjoint Sets 

In our case we have a sequence of elementary foldings: 

To ^ Fi — > . . . — > Tm = r 

The composition, tt = ttm ° ttm-i ■ ■ ■ o m of all the quotient maps tt^ : Fj — > 
Fj+i gives a quotient map tt : Fq ^ F. This map tt, in turn, induces an 
equivalence relation on the vertices of of Fq, i.e v ^ w <^=^ 7r(v) = 7r(w). In 
fact one can consider the vertices of F as equivalence classes of vertices of Fq. 
These equivalence classes are "built" from smaller disjoint sets by successively 
merging them in each elementary folding. For example if the vertices v, w in 
Ti correspond to equivalence classes {vi, . . . ,Vr}, {wi, . . .Wg} respectively and 
if 7ri{v) = Tri{w) — u, then the vertex u of F^+i will correspond to the set 
of vertices {vi, . . . ,Vr,wi, . . . , Ws} C Vertices(Fo). Though this doesn't fully 
motivate our interest in the following data structure and it's clever methods it 
does give an example of how they are going to be used. 

The Disjoint Set Forest data structure has an underlying set of nodes. On 
the set of nodes we have the following primitive operations: 

1. rank:{nodes} N 

2. parent:{nodes} — > {nodes}. 

From this it is seen that nodes can be organized into rooted trees. We have the 

following non-primitive operations: 

1. root:{nodes} {nodes} 

2. merge: {nodes} x {nodes} {trees} 

Some explanations are in order. We have a set X of nodes and we want to 
build equivalence classes out of them. An equivalence class will be encoded as 
a rooted directed tree. We shall identify the trees by their root nodes, i.e. the 
unique node in the tree that has itself as a parent. If we want to know to which 
equivalence class a node n belongs we use the function root(n) which returns 
the root of n's tree, similarly we can check if two nodes are "congruent" by 
checking if they have the same root. We will use the merge(it, v) operation to 
form the union of the equivalence classes containing u and v. It is clear that 
here too some care must be taken to avoid "malformed" trees. 
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Example 2.3. Here is a set partitioned into two equivalence classes. Notice that 
the nodes pointing to themselves are roots or equivalence class representatives. 




Initialization: When a node n is created we need the to set following initial 
values so that everything works: 

1. set parent (n)=n 

2. set rank(n)=0. 

This is like putting n into an equivalence class with only itself in it. 

To perform the root(n) operation we use a method called Find-set(n) which 
takes a node n and returns the node r which is the root of its tree. It is given 
recursively: 

Find-set(n) 

1. If parent(n)=n, return n. 

2. Else set parent(n)=Find-set(parent(n)) and return parent(n). 
Proposition 2.4. This method actually works. 

Proof. We basically do this by induction on the depth of n i.e. the least integer 
M such that: 

parent o . . . o parent(n) = parent o . . . o parent(n) 

^ V ' ^ V ' 

M— 1 times M times 

If the depth is 0, i.e. n is a root, then it works. If it works for all nodes of depth 
M or less and n has depth M + 1 then Find-set (parent(n)) will return the root 
of n's tree and all is well. □ 

Clearly this is not the most expedient way to get the root node (which in 
this case would simply consist of successively evaluating parents until wc hit 
a "fixed point"). However something interesting happens, instead of working 
your way up to the tree root r, you work your way up to the root and then 
back down again and at each step on the way back you set the values of parent 
functions to r. This is called path compression and it makes the tree "bushier" 
and will make successive root operations faster. Here is a situation that could 
arise after performing root(a): 
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Though tree itself changes, the mathematical object it represents is the same: 
we still have the same nodes and the same equivalence classes. The tree, how- 
ever, has been partially optimized. 

The last operation, merge, should takes two nodes a;, y and make the union 
of of the equivalence classes containing x and y respectively. Here we use the 
rank, which is basically an upper bound on the depth of the tree. It is used to 
determine which node will be the new parent. We call the associated method 
Merge(a;,y): 

1. Get Ti =Find-set(a:;), r2 =Fiiid-set(j/). 

2. If rank(ri)>rank(r2) then set parent (r2)=parent(ri). 

3. If rank(r2)>rank(ri) then set parent (ri)=parent(r2). 

4. Else set parent(r2)=ri and set rank(ri)=rank(ri)+l 

We now come to a truly amazing result due to Tarjan whose proof can 
be found in [1]. This proof uses the methods we just described. This result, 
however, is not obvious to prove. An amortized running time is the combined 
running time of a sequence of operations. 

Theorem 2.5. Suppose we perform n Disjoint Set operations, i.e. root and 
merge operations, on a Disjoint Set forest containing N nodes. Then there exist 
methods for the root and merge operations such that the amortized running time 
devoted to these operations will he at most 0{{n + N) ■ log* (N))^ 

2.3 Directed Labeled Graphs 

We now encode a graph. We assume that we are working over F — F{a,b) 
the free group on the alphabet {a,b}. A graph will have two underlying sets 
consisting of vertex objects and edge objects. The idea is that there are functions 
assigning to edges their terminal and initial vertices and each vertex has list of 
adjacent edges. It follows that each edge will be a node in two lists. We will 
also want to organize vertices into Disjoint Set forests and put them in a list 
called UNFOLDED. We have the following primitive operations: 

1. edgelist: {vertices} — > {hsts} 

^The result in [l] actually gives an even better bound: instead of log* it's an inverse 
Ackcrman function. 
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2. initial: {edges} — > {vertices} 

3. terminal: {edges} — > {vertices} 

4. label: {edges} — > {a, b} 

We also want to make lists of edges so we define two instances of the list node 
operations on the set of edges. One instance for the list at an edge's initial 
vertex and one instance for the list at an edge's terminal vertex. Hopefully the 
nomenclature will be self-explanatory: 

1. next-initial:{edges} {edges} 

2. next- terminal: {edges} {edges} 

3. prev- initial: {edges} {edges} 

4. prev-terminal: {edges} — > {edges} 

5. remove-initial:{edges} — > {lists} 

6. remove-terminal: {edges} {lists} 

7. addnodc- initial: {edges} x {lists} — ^ {lists} 

8. addnodc-terminal:{edges} x {lists} {lists} 

And for vertices we have the following additional operations: 

1. next-UNFOLDED:{vertices} {vertices} 

2. prev-UNFOLDED: {vertices} {vertices} 

3. remove-UNFOLDED:{vertices} {hsts} 

4. addnode-UNFOLDED:{vertices} x {lists} {lists} 

5. root: {vertices} — > {vertices} 

6. rank:{vertices} — > N 

7. merge: {vertices} x {vertices} {trees} 

3 Ideas and the Algorithm 

3.1 Elementary Foldings 

Recall that in the sequence of elementary foldings 

Fo ^ Fi — » . . . — *• Fm = r 

The vertices of F^ could be seen as equivalence classes of vertices of Fq. For this 
reason we will denote vertices of Fj as [v] , i.e. "the equivalence class in the set 
of vertices of Fq with representative v." 



10 



Definition 3.1. A vertex [v] is said to be folded if tliere are no edges witli same 
label and incidence an [v]. Otherwise we say [v] is unfolded. 

Consider the following identification of the edges ei and 62 via an elementary 
folding. 



We see that that the vertices [u] and [w] get identified so that in the next 
graph in our sequence the equivalence class represented by u will consist of 
the union [u] U [w] we shall denote this by [u]' . In our computer program 
such an elementary folding would be accomplished by performing the opera- 
tion merge(M, u) (in the example rank(u) > rank(it;)), removing the edge 62 
from the edge lists at w and v (essentially deleting it) and finally performing 
concatenate(edgelist(M),edgelist(?«)). Recall that after an elementary folding 
the edges at [u]' will be the edges at [u] plus the edges at [w] minus the deleted 
edge. This is reflected by concatenating the edgelists and though none of the 
edges in [w]'s old edgelist are set to point to u yet (edges go between vertices, 
not equivalence classes) it is possible to update them. However if we completely 
update all the edges at each folding we'll end up having something that runs 
in quadratic time! Some care is therefore needed. The updating of edges only 
occurs when checking whether a vertex is folded (see Observation [1] in Section 
13. 2p and in the second step of the loop in the algorithm in Section [3731 and when 
either case happens, we only update at most five edges at a time. This is the 
trick to get the algorithm to run in almost linear time. 

Consider the following illustration. The figure on the top is the graph Ti as a 
topological object with vertices corresponding to equivalence classes of vertices 
of Tq. We see that the edges outgoing from [u] labeled a will be identified 
in some elementary folding. The figure on the bottom is at a lower level of 
abstraction, it shows what is encoded in the computer. The circles represent 
"vertex" objects, notice that the vertices parent pointers as well as graph edges 
coming out of (going into) them: 




a 



b 
b 



b 




a 



b 
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Wc sec that the equivalence class [u] contains eight elements, that the t)'s 
edgelist has four entries but that there is only one edge "actually" at v, i.e. 
some edge e with label(e)=6 and initial(e)=w. 

3.2 Detecting Unfolded Vertices 

The only other difficulty is figuring out where to fold. Three observations tell us 
that we can easily keep track of the unfolded vertices and when we know that 
there are none left, then we're done. 

Observation 1. To check whether or not a vertex [v] is folded takes a bounded 
number of operations. Indeed, we need only go through the edge list of [v] and 
check the labels and incidences of the edges. 

To find the incidence of an edge e in [v]'s edge list, find u =initial(e) and 
w =terminal(e) and perform the operations root(M) and root(u>) to find equiv- 
alence class representatives. If for example TOot{u)=v then e is outgoing at [v]. 
Similarly we can determine if e is incoming or forms a simple loop at [v]. At 
this point wc could also update the edges i.e. set initial(e)=root(initial(e)) and 
set terminal(e)=root(terminal(e)) for an extra two operations. 

Now go through the edge list of v. Either you find two edges with same label 
and incidence so [v] is unfolded or you exhaust the edgelist without finding edges 
with the same incidence and label so [v] is folded. Since we are assuming that 
we are working over F{a, b) it is clear that an edgelist with five or more entries 
must result in unfoldedness. It follows that we never check more than 5 edges 
at a time. 

Observation 2. An elementary folding is an essentially local operation. That 
is, whenever two edges get identified we need only to check for three vertices 
whether they have gone from being folded to unfolded or vice- versa. Any vertex 
that is not the initial or terminal vertex of some edge being identified with 
another edge at that elementary folding will have the same number of incoming 
and outgoing edges after the elementary folding. 

Observation 3. At the beginning there is exactly one imfoldcd vertex, i.e. 
where we initially attach our loops, and the algorithm terminates when there 
are no unfolded vertices left. 

These three observations tell that we can have a list called UNFOLDED 

which contains exactly the unfolded vertices and that at each elementary folding 
we need perform a bounded number of primitive, ordered set and disjoint set 
operations to keep it updated. 

3.3 The Algorithm 

We will make a distinction between ordered set operations and disjoint set op- 
erations. We will call primitive operations and ordered set operations simply 
"operations" and mention disjoint set operations explicitly. 
Initialization: 
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We are given an input (Ji, . . . , J„) of reduced words in F{a, h). For each 
Ji we make a directed labeled loop U with label Ji starting at vq and initialize 
each vertex as in Section [^T^ we call the resulting graph Fq. At this point there 
is only one unfolded vertex: vq. We also create the list UNFOLDED containing 
the single vertex vq. 



All this takes time 0{N). 
Folding: 

While UNFOLDED is not empty do the following: 

1. Get D=head(UNFOLDED) to get an unfolded vertex. This costs 1 oper- 
ation. 

2. Get L=edgelist(w). Get ei=head(L) get Mi=root(initial(ei)), tii=root(terminal(ei)) 
and label(ei) to get the label and incidence of ei at [v\. Then set initial(ei))=ui 

and set terminal(ei)=ui to "update" the edge. Take 62= either next- 
initial(ei) or next-terminal(ei) (depending on the incidence of ei) and 
again get the incidence, get the label and update the edge. Keep perform- 
ing "next" operations until you get two edges with the same label and 
incidence and can fold. This costs l-fl operations -I- < 5 • (6 operations -|- 
2 disjoint set operation + some constant amount of time) 

At this point we have found 2 edges €^^,6^2 (without loss of generality 61,62) 
with same incidence and label. We have four possible local situations: 
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62 




From Step 2 we know the the endpoints of 62 and ei and can therefore 
estabhsh which case we are deahng with (this takes constant time) . 

Case I: 

1.1 merge ( u, w) (assume the new representative is u.) This costs 1 disjoint 
set operation. 

1.2 if necessary, remove the non representative vertex w from UNFOLDED. 
This costs 1 operation. 

1.3 concatenate(edgehst(u),edgehst(w)). This costs 1 operation. 

1.4 We assume that 62 is the edge going from v to w. Then we do remove- 
initial(e2) and remove-terminal(e2). At this point we can assume that 62 
is deleted. This costs is 2 operations. 

1.5 Check whether the remaining vertices [u] and [v] are folded and add or 
remove them from UNFOLDED accordingly. By Observation [T] this again 
takes a bounded number of disjoint set and "normal" operations. 

How to handle cases II-IV is similar and will not be given. When we exit 
the "while" loop, i.e. UNFOLDED is empty, the algorithm terminates. All the 
remaining edges point to their representative vertices and no vertex is unfolded, 
so we have a usable folded graph. 

3.4 Analysis 

Each time the "while" loop executes an edge gets deleted so the loop runs at 
most N times i.e. the total length of the input. Each run through the loop in 
fact corresponds to an elementary folding. Each time the loop runs, a constant 
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bounded number of "standard" and disjoint-set operations are executed so ap- 
plying Theorem [23] this runs in time 0{N) + 0{Nlog*{N)) = 0{N\og*{N)). 
This proves the main result, Theorem 11.41 We can also give the following: 

Proof of Theorem \1.6\ We do a search through our graph and check at each 
vertex v if it is folded. If not then we add v to UNFOLDED. The search takes 
time 0{E). We then proceed as usual. □ 
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